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CHAPTER  ONE 


(A)  Introduction 


(Al)  Detection  with  Known  Covariance 


Let  ns  consider  the  problem  of  detecting  a  signal  in  gaussian  noise 
where  both  signal  and  noise  are  assumed  to  be  real  valued,  the  two 
hypotheses  are 

H0 :  x  =  n  (noise  only)  (1.00) 

H^:  x  =  n  +  s  (signal  present)  (1.01) 

where  x  is  the  vector  of  the  observed  data;  n  is  a  zero-mean  gaussian 

T 

random  vector  with  covariance  matrix  E(nn  )  =  N  ;  and  s  is  the  signal 

to  be  detected.  The  dimensions  of  x,  n,  and  s  are  pxl. 

Under  these  conditions  it  can  be  shown  that  a  likelihood  ratio 
test  statistic  [4]  is 

z  =  xT  N-1s  (1.02) 

Equivalently,  the  test  statistic  z  can  be  considered  as  the  inner 

product  of  x  and  weight  vector  w. 

(1.03) 
(1.04) 

Brooks  and  Reed  [4]  have  shown  that  selecting  a  weight  vector 
according  to  formula  (1.04)  is  the  same  as  maximizing  the  signal-to- 
noise  ratio  (SNR).  We  can  express  this  as  maximizing  the  quadratic 

ratio 


T 

Z  =  X  w 


where  w  -  N  ^s. 


SNR  = 


T  T 
w  ss  w 

T 

w  Nw 


(1.05) 


The  weight  vector  that  maximizes  this  ratio  (see  [1,2,4])  is 
w  =  N  ^s 


(1.06) 


The  maximum  SNR  is 
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SNRmax  =  sTN  A. 


(1.07) 


(A2 )  Standard  Adaptive  Detection  with  Unknown  Covariance 
In  practice  we  do  not  know  the  noise  covariance  matrix  and  so  it  is 
usually  estimated  from  the  data.  The  maximum-likelihood  estimate  of 
the  noise  covariance  matrix  [7]  is 
K 

-  IX  T 

N  =  2  njnj  (1.08) 

j=l 


where  the  observed 

noise 

vectors. 

Uj  ,are  pxl 

vectors 

which 

are 

mutually  independent 

and 

gauss ian 

distributed  wi 

th  zero 

mean 

and 

covariance  matrix  N. 

Following  standard  methods 

one  can 

obtain 

an 

estimate  of  the  weight  vector  by  inverting  the  sample  covariance  matrix 
[1,2,3]  as  follows: 

w  =  N-1s  (1.09) 

To  measure  the  effectiveness  of  this  estimate  of  w  [1],  we  can  use  a 
normalized  SNR  which  is  formed  by  (a)  replacing  w  by  w  in  formula 
(1.05)  and  (b)  dividing  by  the  maximum  SNR  value  of  formula  (1.07)  . 

The  resulting  normalized  SNR  is  given  by  the  formula 

SNR  =  SS  w  -  (1.10) 

(w  Nw)(sXN  s) 

This  ratio  is  always  between  zero  and  one 
0  <  SNR  <  1 

It  is  a  random  variable  because  the  estimated  weight  vector  w  is  a 
function  of  the  observed  data.  Reed,  Mallet , Brennan  [1]  have  derived 
the  distribution  of  the  SNR  for  the  above  weight  vector  estimate  based 
on  the  inversion  of  the  sample  covariance  matrix.  The  distribution 
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is  Beta  with  expected  value 

E(SNR)  =  -^y7T  P  (1.11) 

where  K  is  the  number  of  vectors  used  to  estimate  the  covariance  matrix 

and  p  is  the  matrix  order  * 

From  the  expected  value  of  SNR  formula  (1.11),  it  is  roughly  seen 
that  if  the  sample  size  K  is  small  with  respect  to  the  matrix  order, 
then  the  estimate  of  w  is  likely  to  be  poor  [3],  since  E(SNR)  is  small. 

(A3 )  Improved  Adaptive  Detection  for  Unknown,  but  Approximately-Low- 

Rank  Covariance 

If  N  is  approximately  low  rank,  it  can  be  shown  theoretically 
through  eigenvalue  and  eigenvector  perturbation  analysis  (  Wilkinson 
[9]  )  and  experimentally  [10]  that  the  principal  eigenvalues  and 

eigenvectors  of  N  are  relatively  stable,  but  the  small,  near  zero 
eigenvalues  and  their  corresponding  eigenvectors  fluctuate  widely  with 
perturbation. 

These  results  suggest  that  it  should  be  possible  to  increase  the 
probability  of  obtaining  a  high  value  of  SNR  by  using  estimates  of  w 
based  on  the  principal  eigenvectors  of  N  .  Let  us  look  at  w  by 
decomposing  it  in  terms  of  the  eigenvectors  of  the  underlying  true 
covariance  matrix,  N  .  The  eigen  decomposition  of  N  is  N  =  V  A  where 
V  is  the  matrix  of  eigenvectors  and  A  is  the  diagonal  matrix  of 
eigenvalues.  The  k'th  eigenvector  of  N  is  denoted  by  v^  . 

> 

Then  the  desired  weight  vector  of  (1.04)  can  be  written  as 
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w  =  N  ^s  = 


X. 


T 

(s  v^)v^  + 


X„ 


(sTy2)v2  + 


-r—  (sTv  )v  (1.12) 
Xrt  P  P 


This  formula  shows  the  origins  of  the  difficulty  in  using  the  estimated 
weight  vector  of  (1.09).  The  right-hand-side  eigenvectors  and 
eigenvalues  of  (1.12)  would  then  be  replaced  by  the  corresponding 
estimated  values.  The  fluctuations  in  the  small  eigenvalues  can  then 
cause  large  errors,  because  their  reciprocals  are  used  in  the 
computation  of  the  weight  vector.  Next  assume  that  ^2  =  ^3  =  '  •  *'  = 
Xp  and  consider  the  case  in  which  X^  is  much  larger  than  the  other 
eigenvalues.  Let  us  consider  the  limiting  weight  vector  as  Xx  ->®. 

lim  w  =  — f(sTv0)vo  +  (sTv0)v:J  +  .  .  .  +  (sTv  )v  ]  (1.13) 

14.  X,  l  2  2  3  3  p  pj 


Neglecting  the  scale  factor  I/X2  which  does  not  affect  SNR,  we  can 
express  w  as 


lim  w 
Xj->® 


=  s 


(1.14) 


This  form  of  the  weight  vector  can  be  intrepreted  as  a  nul  1-steerer, 
because  it  eliminates  any  component  which  is  proportional  to  a  specific 
vector,  in  this  case  v^  .  Liu  and  Nolte  [5]  have  shown  that  when  the 
noise  covariance  matrix  N  is  near  rank  1  and  the  component  of  the 
signal  lying  in  the  direction  of  v^  is  not  strong,  then  the  performance 
of  the  weight  vector  of  (1.14)  is  about  the  same  as  the  optimum  weight 
vector  of  (1.04).  For  the  case  of  unknown,  but  approximately  low-rank 
covariance,  motivated  by  the  above  considerations,  we  propose  the  use 
of  the  following  weight  vector: 
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w  =  s  -  (s^v^v^  (1.15) 

where  is  the  principal  eigenvector  of  N.  In  previous  work  we 

proposed  this  weight  vector  for  adaptive  detection  and  evaluated  its 
performance  through  simulation  [15]  .  Here  we  study  the  performance 

analytically  in  order  to  explain  the  results  of  the  simulation. 

Since  this  estimate  is  based  on  the  principal  eigenvector  of  N, 
and  the  principal  eigenvectors  are  relatively  unaffected  by 
perturbation  [10],  it  should  be  superior  to  the  conventional 
estimator  based  on  the  inversion  of  the  sample  covariance  matrix. 

Using  the  null  steerer  form  of  the  weight  vector  formula  (1.15) 
and  an  approximation  for  the  principal  eigenvector  (of  the  estimated 
covariance  matrix  N)  obtained  through  one  iteration  of  the  power 
method,  we  will  derive  an  approximate  expression  for  the  distribution 
of  SNR,  formula  (1.10)  under  the  conditions  of  near  rank-1  noise  and 
large  sample  size.  Below  is  a  brief  outline  of  the  steps  we  will  take; 


(1)  Transform  SNR  formula  (1.10)  into  new  coordinates  based  on  the 
eigenvectors  of  N,  that  is 


SNR  = 


P  P 

i  i  dj 

j  =  l  k=l 


2  p 


(1.16) 


1  5T  1 


X  d2 
n  n 


m=l 


n=l 


with  c^  =  v^  s 


(1.17) 

>  (1.18) 
and  where  Xm  and  v^  are  the  eigenvalues  and  eigenvectors  of  N, 


dfc  =  vkTw  =  vkT  (  s  -  (sTv-,)vi  ) 
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re  spect ively. 

(2)  Obtain  an  approximation  for  the  principal  eigenvector  of  N,  , 

by  taking  one  iteration  of  the  power  method  [11]  using  v-^  as  the 
starting  vector. 

▼!=?!»  Nvj  (1.19) 

where  v^  denotes  our  approximation  to  v^. 

(3)  Expand  v-j,  using  the  eigenvectors  of  N  as  a  basis. 

x  =  VTv1  (1.20) 

and 

vx  =  Vx  (1.21) 

Asymptotically,  the  expansion  scale  factors  in  vector  x  are  gaussian  as 
the  covariance  sample  size  tends  toward  infinity. 

(4)  Using  the  expansion  (1.21)  of  v^  in  place  of  v^  in  formula  (1.18), 
substituting  (1.18)  in  (1.16)  and  approximating  the  distribution  of  x 
by  a  gaussian  distribution,  then  as  the  noise  tends  toward  rank  1,  SNR 
formula  (1.16)  reduces  to  a  ratio  of  quadratics  that  are  a  function  of 
one  random  variable. 

ai  +  a,  p  +  a,  p2 

SNR  =  — - - - - (1.23) 

a4  +  a5  p  +  ag  p 

where  the  a^,  k=l,2..6  are  constants  and  P  is  a  ratio  of  two 

asymptot icaly  gaussian  and  uncorrelated  random  variables. 

(5)  Finally  using  formula  (1.23),  the  distribution  of  P  (  the 
distribution  of  ratios  of  gaussians  [6]  is  available  in  closed  form  )  , 
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and  standard  univariate  random  variable  transformation  theorems,  the 
approximate  distribution  of  SNR  can  be  readily  obtained*  The  paper  will 
be  presented  in  three  main  parts;  (1)  Reduction  of  SNR  assuming  near 
rank-1  noise  and  large  sample  size,  (2)  Finding  the  approximate 
probability  density  of  SNR  using  the  reduced  form,  and  finally,  (3) 
experimental  results  . 
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CHAPTER  TWO 

I )  Reduction  of  SNR  assuming  near  rank  1  noise  and  large  sample  size. 


Coordinate  Transformation  of  SNR 

We  start  the  derivation  by  re-expressing  the  signal  and  weight 
vectors  in  terms  of  the  eigenvectors  of  the  N,  recalling  that  the 
eigenvectors  of  N  form  a  basis.  This  coordinate  transformation  makes 
the  problem  more  tractable  analytically.  Performing  the  coordinate 
transformation  we  obtain 

P 

s  =  }  ck  vk  (2-00) 

k-1 

P 

W  =  }  dk  vk  (2.01) 

k=l 


where  the  v^'s  are  the  eigenvectors  of  N.  Now  substitute  formulas 
(2.00)  and  (2.01)  and  the  eigen-decomposition  of  N  into  SNR,  formula 
(1.10). 


P  P 


SNR  = 


i  i  dj  dt  ‘j 

j  =  l  k=l 


(2.02) 


2  p 


1  >r  1 


k  d2 
n  n 


m=l 


n=l 


where  Xj  are  the  eigenvalues  of  N.  ^  The  dj  's  are  random  variables  that 
are  a  function  of  w.  So  far  no  approximations  have  been  used.  We  simply 
have  a  different  expression  for  SNR. 

The  quadratic  forms  in  formula  (2.02)  that  involve  the  random 
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scale  factors  dj  can  be  thought  of  as  linear  combinations  of  the 

products  djd^..  With  this  in  mind,  we  will  proceed  by  first  determining 
the  approximate  form  or  distribution  of  the  products  djd^  under  the 
asymptotic  conditions  as  ^2~ ^  ®  and  ^ 00  (near  rank-1  covariance  and 
large  sample  size)  .  If  we  refer  back  to  formula  (1.18),  it  can  be  seen 
that  the  sole  contribution  to  the  random  component  of  random  variable 
dj  is  from  v-p  the  principal  eigenvector  of  the  estimated  sample 
covariance  matrix.  Therefore,  the  next  step  is  to  determine  the 
approximate  distribution  (  as  0  and  K  ->»)  of  v^.  From  this  point 
onward  we  assume  that  the  noise  is  gaussian  and  strongly  rank  one, 
that  is,  the  noise  covariance  matrix  is  approximatly  rank  1.  To 

simplify  the  analysis,  the  principal  eigenvalue  of  N,  fixed  at  1 

without  loss  in  generality.  Also,  assume  that  the  remaining 

eigenvalues  are  much  smaller  than  1  and  equal. 

Xi  =  1  >  >  X2  =  X3  =  .  .  .  =  kp  (2.03) 

The  form  of  the  weight  vector  that  we  will  be  using  is  the  null 

steerer  (1.15)  . 

w  =  s  -  (s  v1)v1  (2.04) 

Approximating  the  Principal  Eigenvector  of  N 

To  estimate  v-^  ,  the  principal  eigenvector  of  N  ,  we  use  a  three- 

step  procedure.  First  take  one  iteration  of  the  power  method  [11]  using 

v^  (recalling  that  v^  is  the  principal  eigenvector  of  N)  as  the 

starting  vector.  We  then  represent  the  resulting  vector,  Nv^  ,  in 

> 

terms  of  the  principal  eigenvectors  of  the  true  covariance  matrix  N  as 
follows 
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N  vi  =  V  x 


(2.05) 


in  which,  the  columns  of  V  are  the  corresponding  eigenvectors  of  N. 
Finally,  we  form  our  estimate  of  v^  ,  which  we  denote  by  by 
normalizing  the  above  vector  to  unit  length 

v:  =  [  1  /  (xTx)l/2  ]  V  x  (2.06) 
where  x  is  a  pxl  vector  with  elements  {x^}  containing  the  expansion 
scale  factors. 

We  have  shown  in  a  previous  paper  [10]  that  if  the  true 
covariance  matrix  of  the  noise,  N  ,  is  approximatly  rank  1  ,  then  even 
for  small  sample  sizes  of  16  or  32  observations,  v^  lies  in  nearly  the 
same  direction  as  v^  (  see  Fig.  1).  The  rate  of  convergence  of  the 
power  method  [11]  is  proportional  to  the  magnitude  of  the  ratio  of  the 
principal  eigenvalue  to  the  second  eigenvalue  and  since  the  starting 
vector  is  the  principal  eigenvector,  v^  >  of  the  underlying  population 
covariance,  it  follows  that  in  the  near  rank  1  case  convergence  should 
be  rapid  ,  implying  that  v^  should  be  an  accurate  estimate  of  v-^  . 

In  appendix  A  we  show  that  the  scale  factors  (elements  of  x)  are 
asymptotically  multivariate  gaussian  and  independent  as  follows: 

Xl  -  N(  1  ,  2/K  )  (2.07) 


x^  -  N(  0  ,  ^/K  )  for  k=2,3...p 


(2.08) 


> 

Determining  the  Weight  Vector  Expansion  Coefficents  d^ 

Let  us  now  find  the  expansion  coefficients  d^  of  formula  (2.01)  . 
To  obtain  the  d^.  coefficents,  pre-multiply  (1.15)  by  the  k'th 
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dk  =  vkTw  =  vjs  -  (  ) 


eigenvector  of  N. 

(2.09) 

Note  that  c^=Vj^s  .  Then  substitute  (2,06)  in  place  of  v-^  in  the 
weight  vector  expression  (2.09)  and  expand 


d  =  c 
k  k 


5  c.  X. 

L  J  J 

izl 


} 

j=i 


1/2 


1 

j=l 


1/2 


(2.10) 


d  -  c 
k  k 


C1  X1  Xk 
2 

X1  +  2 


y 


e 


where 


P 


j=2 


(2.11) 


(2.12) 


(2.13) 


Before  we  form  the  products  djdk  ,  it  is  noted  that  the  normalization 
terms  in  dk  (2.11)  are  simplified  to  a  function  of  as  ->  0 
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since  the  variance  of  the  Xj 's  (for  j=2,3...p)  are  proportional  to  k2 
This  corresponds  to  the  near  rank  1  case  . 


The  right-hand  side 
normalization  term  for 
terms  in  formula  (2.11) 


—  (2.14) 

xi 

of  (2.14)  is  a  good  approximation  pf  the 
sufficently  small  X2  .  Replace  the  normalization 
by  the  approximation  (2.14)  . 


dk=  ck 


ci  \ 


xk y 


(2.15) 


Reduction  of  the  Products  djd^,  Under  Near  Rank-1  and  Large  Sample 

Condition 

Using  the  formula  (2.15)  and  assuming  that  the  error  due  to  the 
simplification  of  the  normalization  term  (2.14)  is  neglible,  we  next 
compute  djdf 
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d . 
J 


c.c  - 

j  fc 


cic.i^ 


1  k  J 


c.x.  y 
J  k 


(2.16) 


2  .  2 
c,x.y  c.x.x,  2c-x.x,y  x.x,y 

-  _ 1 Lil _  +  _ LiJL.  + _ LjJl  .  +  -J-  k 

2  2  3  4 

X1  X1  X1  X1 

We  now  determine  the  behavior  of  the  products  d^d^.  (2.16)  in  the  near 
rank-1  (X^^  0)  and  large  sample  case  (K->®).  This  can  be  done  through 
calculation  of  the  expected  values  and  variances  of  the  individual 
random  terms  in  (2.16).  From  these  calculations  (see  Appendix  B)  it  can 
be  seen  that  the  variance  and  expected  value  of  the  i'th  random  term  ( 
for  j,k^l,l  )  in  (2.16)  is  roughly  proportional  to  the  ratio  (X^/K)21 
where  z .  is  some  integer  number.  This  implies  that  as  X^-^  0  and 
the  term(s)  (  in  formula  (2.16)  )  having  a  variance  proportional  to  the 
least  power  of  X^/K  will  contribute  the  dominating  variance  to  djd^. 

(2.16).  It  follows  that  under  these  conditions,  the  random  component 
of  djd^  should  be  accurately  approximated  by  the  dominating  random  term 
in  (2.16)  in  respect  to  variance. 

The  approximate  expressions  for  the  products  d.dv  are  obtained 

J  x. 

using  the  above  methodology  (with  the  exception  of  d<  ,  which  can  be 
simplified  algebraicly) .  We  have 
For  j  =1  ,  k=l 


(2.17) 


for  j=l,  k^l 
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dl  dk  8  Dlk 


Ck  y 


Finally  ,  for  j=2,3...p 

k=2, 3. . . p 


d. 

J 


C1 


c.  +  c,  x. 
J  *  J 


X 


1 


(2.18) 


(2.19) 


where  the  approximating  form  of  djd^  is  denoted  as  Dj^.  It  is  assumed 
that  c^O  in  the  above  formulas.  For  sufficently  small  ^  and 
reasonable  values  of  K,  the  should  be  good  approximations  to  the 

djl^'s  .  We  note  that  formulas  (2.17)  ,  (2.18)  and  (2.19)  are 
functions  of  random  variables  which  are  ratios  of  gaussian  random 
variables . 


Simplification  of  SNR  with  D., 

-  - - - 

Substituting  (  formulas  (2.17)  (2.18)  (2.19)  )  in  place  of 

djd^  in  formula  (2.02)  and  through  algebraic  manipulation  of  the 
numerator  and  denominator  terms,  we  can  transform  SNR  (2.02)  to  the 
desired  form,  formula  (1.23) 

P 

5  c. 

L  J  J 

j  =2  y 

where  0  =  — J -  =  -  (2.20) 

X1  *1 

> 

Start  by  simplifying  the  numerator  of  SNR.  From  (2.02)  the  numerator 
(  denoting  the  numerator  as  n)  is 


14 


TR  7331 


P  P 

n  =  >  )  d.d.  c  .1 

L  L  j  k  j 

j=l  k=l 


(2.21) 


Separate  the  numerator  double  summation  in  terms  of  ,  d^  (for 

k=2,3...p)  and  djd^.  (for  j , k=2, 3. . . p)  . 


n  = 


C1  di  +  2ci  )  c.  d * d,  +  \  \  d  d  c  c 

11  1  £.  k  1  k  L  L  n  m  n  m 

k=2  n=2  m=2 


(2.22) 


Through  (1)  substitution  of  Dj^  (  formulas  (2.17)  (2.18)  (2.19)  )  in 

place  of  djd^.  in  formula  (2.22),  (2)  interchanging  the  order  of 
summation  in  the  last  term  of  n  (2.22)  and  factoring,  and  finally  (3) 
the  collection  of  equivalent  terms  ,  the  numerator  (2.22)  can  be 
written  as 

(2.23) 


’  p  p 

*  p 

\  \  2  2 

2  2 

\  2 

/  )  c  c 

+  c.  v  -4  c, 

)  ci 

L  L  n  m 

1  J  1 

L  k 

ji=2  m=2 

0 

>=2 

1  1 

The  numerator  is  now  in  the  desired  form.  We  simplify  the  denominator 
in  a  similar  manner.  From  (2.02)  the  denominator  (denoting  the 
denominator  as  d)  is 


d  = 


‘  P  2 

P 

\  J 

2  x. 

u=i  J  . 

.  k=l 

(2.24) 


As  stated  previously  ,  we  assume  that 


*i  - 1 


and 


^•9  —  —  Xa  —  .  •  •  ,  —  X 
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Now  separate  the  denominator  summation  in  terms  of  and  dj  (  for 

j=2,3...p)  and  the  X2  and  I/X2  scale  factors. 


j-2 


P 

z 

k=2 


2.2 

ci  d  • 

k  j 


_1_ 


5 

k=2 


2.2 

c  a 

VI 


+ 


K  2,2 
2  cidj 


j-2 


(2.25) 


Then  as  before,  through  (1)  substitution  of  (  formulas  (2.17) 
(2.18)  (2.19)  )  in  place  of  djd^  in  (2.25),  (2)  interchanging  the  order 
of  summation  in  the  second  and  fourth  terms  of  (2.25)  and  factoring, 
and  finally  (3)  the  collection  of  equivalent  terms,  the  denominator  can 
be  written  as 


’  p 

\  2.,  ^  2 

2 

’  P  P 

\  \  2  2 

,  2 

P 

V  2 

2  Ck/X2  +  C1 

y  + 

2  2  Vj 

+  Vi 

2  ck 

.k=2 

2 

j-2  k=2 

.  k=2 

xi 


2  c. 


I 

Lk=2 


+  Vi 


(2.26) 


Using  the  simplified  forms  of  the  numerator  (2.23)  and  denominator 
(2.26)  and  forming  their  ratio  ,  the  approximate  SNR  is 
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SNR  = 


a  +  axP  +  a20 
a  +  A  +  a^  P  +  a^P^ 


where  =  -  4 


k=2 


a2  C1 


P  P 


•  -  3  K 

j=l  k=l 


2  2 
Ck 


A  =  X2cx 


3 

Lk=2 


a3  =  "  2  C1 


3 

Lk=2 


+  X2C1 


a4  = 


5  4' 


k=2 


+  c„ 


(2.27) 

(2.28) 

(2.29) 

(2.30) 

(2.31) 

(2.32) 

(2.33) 


The  SNR  is  now  a  function  of  one  random  variable,  0  .  We  have  obtained 
the  form  of  SNR  that  we  wanted.  The  density  of  SNR  can  now  be  readily 
be  obtained  using  standard  univariate  transformation  theorems  for 
functions  of  random  variables. 


Validity  of  Approximations 

Although  earlier  we  stated  that  the  reduced  formulas  for  D.v 

J  ^ 

(2,17),  (2.18),  and  (2.19)  only  hold  for  Cj^O  for  j=l,2...p  and  c^O 
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for  k=l,2...p  ,  our  above  result  (2.27)  is  valid  even  when  some  of  the 
Cj's  and  ck's  are  zero  or  very  small.  This  is  because  the  Djk's 
associatted  with  the  relatively  large  non-zero  Cj  's  and  c^'s  contribute 
the  dominating  variance  in  formulas  (2.23)  and  (2.26)  .  By  comparison, 
the  Djk's  associated  with  the  zero  or  very  small  cj's  and  ck's 
contribute  generally  little  variance  to  (2.23)  and  (2.26)  under  the 
near  rank-1  and  large  sample  size  condition. 

The  accuracy  of  the  approximation  for  SNR  (2.27)  can  be  determined 
through  the  error  calculations  in  Appendix  B. 
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CHAPTER  THREE 

II)  Determining  the  approximate  probability  density  of  SNR  using  the 

reduced  form. 

In  section  I  it  was  shown  that  when  the  noise  covariance  matrix 
is  almost  rank  1  and  the  sample  size  is  sufficently  large  ,  the  SNR 
reduces  to  a  function  of  a  single  random  variable  0  that  is 
approximatly  a  ratio  of  gaussians.  Obtaining  the  density  of  SNR  is  now 
a  simple  two  step  procedure: 

1)  Determine  the  density  of  0  . 

2)  Using  standard  univariate  transformation  theorems  and  the  density 
of  0,  obtain  the  density  of  SNR. 


Determining  the  Density  of  0 

Recall  from  section  I  that  0  (2.20)  is 


0  = 


l  Vi 

J“2 


(3.00) 


In  appendix  A  it  was  shown  that  the  x^'s  for  reasonable  sample  size  K 
tend  toward  gaussian,  therefore  the  random  variable  0  can  be 
approximated  as  a  ratio  of  independent  gaussian  random  variables.  From 
appendix  A  the  normal  approximations  were  shown  to  be: 

xx  _  N(l,  2/K)  (3.01) 

~  N(0,  X2/K)  for  k=2,3,...p  (3.02) 

We  can  therefore  consider  0  as  a  ratio  of  two  gaussian  random  variables 
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,  z  and  u  as  follows: 

P  =  x/n  (3.03) 

where 

(3.04)  (3.05) 


j=2 


The  means  and  variances  of  x  and  u  are 

E[x]  =1=0,  E[u]  =  u  =  1  (3.06) 


P 


U=2 


a2  =  2/K 
u 


(3.07) 


Kanter  [6]  has  derived  a  general  form  of  the  probability  density  for 
the  ratio  of  two  ganssian  random  variables  ,  using  the  same  notation 
as  before  we  have 


p(p)  “  ]  exp  £  jj(s  +  1)J  /  (s?p)  +  1) 

(3.08) 

•  £z(p)  erf  (  z  ( P )  )  exp (  zfp)  )  +  — ^r-  j 

where  a  =  o  ,  b  =  o 

(3.09) 

x  u 

r  =  correlation  coefficient  0  <  r  <  1 

(3.10) 

y  *  ab  \/(l-r^) 

(3.11) 

0  =  52/  2b2 

> 

(3.12) 

s(0)  =  (b^0  -  rab)/y 

(3.13) 

s  =  (b^(x/u)  -  rab)/y 

(3.14) 

z(p)  =  V0  (  s  s(p)  +  1  )  /  V(  s^p)  +  1  ) 

(3.15) 
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Noting  that  the  correlation  coefficent  is  zero  (  r=0  )  since  x^ 
and  x^.  for  k=2,3...p  are  approximat ly  independent,  we  can  now  obtain 
the  density  of  P  directly  through  substitution. 


p(P>  =  111  /vkx2r)]  [exp  -K/4]  /  [(2/X2r)  p2  +  1] 


(3.16) 


vfc  /  2 

erf 

'  A  /  2 

K/4 

1 

4- 

V[(2/X2D2P2+1  ]. 

yt(2/x2i?p?u. 

e  xp 

.  (2/D  p2  +  1  . 

Vn 

P 


where  T 


i 


2 
c . 

J 


j-2 

We  have  obtained  the  density  for  p. 


(3.17) 


At  this  point  we  can  derive  the 


approximate  density  of  SNR. 


Finding  the  Approximate  Density  of  SNR 

To  calculate  the  approximate  density  of  SNR,  we  need  the  use  of 
the  following  random  variable  transformation  theorem  [8] 

Theorem  A:  Given  a  function  g(0),  where  p  is  a  random  variable  with 
density  p(p)  *  the  density  of  g(0)  can  be  found  using  p  ( p )  as 
follows:  we  solve  the  equation  y=g(0)  and  denote  its  real  roots  by 

Pl,P2 - Pn.  Clearly,  the  values  of  the  roots  depend  on  y.  Then  the 

density  of  y  is  given  by  the  formula 


P<  P:  ) 

_  4.  4.  _ 

P(  pn  ) 

g(  Px  > 

'  .  .  •  * 

> 

g(  pn  ) 

(3.18) 
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where 


g(  P  ) 


and 


d  g(0) 

dP 


g<P)  = 


a  +  axP  +  a20 


a  +  A  +  a^p  +  a^p 


(3.19) 


(3.20) 


Since  g(p)  is  a  ratio  of  quadratics,  it  follows  that  there  are  two  real 
roots.  Multiplying  both  sides  of  formula  (3.20)  by  the  denominator  of 
g(p)  and  collecting  terms  we  have 


ya  +  yA  +  ya^p  +  ya^P  “  a 


+  al^  +  a2^ 


(3.21) 


(ya4  -  a2)p2  +  (ya3  -  a^p  +  (a[y-l]  +  yA)  =  0  (3.22) 

Note  that  formula  (3.22)  is  in  the  form  of  a  standard  quadratic, 
therefore  the  standard  root  formula  for  quadratic  equations  can  now  be 
applied  to  obtain  the  roots  of  g(p)  .  The  two  roots  are 


(a, 


1,  2 


-  ya3)  +  £  (ya3~a1)2  -  4(ya4  -  a2>  (a[y-l]  +  yA  )  j 


1/2 


2(ya4  -  a2) 


(3.23) 


Next  we  determine  the  derivative  of  g(p)  with  respect  to  p. 
Differentiating  we  get 


dg  (p) 

-  =  (a  +  2a„0) 

dP  2 

-(a  +  a^P  +  a202) 


(a  +  A  +  a30  +  a402) 

*  2  -2 
(a3  +  2a4p)  (a  +  A  +  a3P  +  a4P  ) 


(3.24) 
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We  can  now  obtain  the  approximate  density  of  SNR  through  direct 
substitution  using  theorem  A  formula  (3.18),  the  density  of  p  (3.16), 
the  roots  Pl.2  (3.23)  and  the  derivative  g'(p)  (3.24).  Denoting  the 
density  of  SNR  as  f(y)  ,  we  get 


f  (  y 


P(  ) 
g(  Px  ) 


p(  h  ] 

g(  p2  ) 


(3.25) 


We  recall  that  p^  and  P2  are  functions  of  y.  The  dependence  on  y  is 
given  in  formula  (3.23).  The  density  f(y)  exists  over  the  region  where 
P^  and  P2  are  real  . 


Asymptotic  Moments  of  SNR  when 

The  formulas  we  have  derived  for  the  probability  density  of  SNR 

(3.25)  are  complicated  and  one  would  probably  have  to  resort  to 
numerical  evaluation  of  the  integrals  to  obtain  the  first  and  second 
moments  of  SNR.  However,  in  the  extreme  case  when  it  can  be 

shown  that  asymptotically  as  K  — 


SNR 


1  - 


(  1  - 


2  .2 


K 


(3.26) 


where  z~N(0,l)  and  "d"  implies  convergence  in  distribution.  Using 

(3.26)  we  can  readily  obtain  the  expected  value  and  variance  of  SNR. 
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E[  SNR  ] 


-  (  1  - 


2  \2 

C1  ) 


K 


(3.27) 


Var [  SNR  ] 


2 


(3.28) 


Proof:  First,  it  was  shown  in  Appendix  A  that  the  numerator  and 
denominator  of  P  (3.00)  are  asymptotically  gaussian  (see  Appendix  A  for 
detail).  Through  application  of  a  theorem  for  the  asymptotic 
distribution  of  a  function  of  asymptotically  gaussian  random  vectors 
[Theorem  B,  pg.  124,14]  ,  it  is  seen  that  p  (3.00)  itself  is 
asymptotically  gaussian  as  K  as  follows: 


P 


1/2 

z 


(3.29) 


where  z~N(0,l/K)  .  Next,  without  loss  in  generality  set  the  signal 

power  to  unity,  that  is 


j=i 


(3.30) 


The  summation  in  (3.29)  can  now  be  rewritten  as  a  function  of  c^ 
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t  [  h  ( 1  -  °1  >  ] 1/2 


(3.31) 


substitute  (3.31)  in  place  of  P  in  formula  (2.27)  and  let  0  (note 

that  is  constrained  to  be  c^-l  in  formula  (3.31)  ). 


SNR  % 


1 


2  2 
1  +  (  1  -  )  zZ 


(3.32) 


Finally  using  (3.32)  and  [  Theorem  B,  pg.  124,14]  (asymptotic 
distribution  of  functions  with  vanishing  first  order  derivatives)  we 
get  the  asymptotic  distribution  of  SNR  as  K  -><»  . 

These  formulas  should  generally  give  a  good  estimate  of  the 

moments  of  SNR  even  for  the  general  case  when  X2  is  close  to  zero  and 

K  is  large.  Using  the  formulas  for  the  expected  value  of  SNR  for  the 

low  rank  filter  weight  estimate  formula  (3.27)  and  formula  (1.11) 

when  the  filter  weights  are  based  on  the  inversion  of  the  sample 

covariance  matrix,  we  can  roughly  determine  the  number  of  samples 

needed  to  attain  equivalent  performance  (  in  respect  to  the  expected 

values  of  SNR  for  both  methods  )  using  the  conventional  filter  weight 

estimate  (1.09)  compared  against  the  improved  rank-1  filter  weight 

estimate  (1.15)  .  Denoting  the  number  of  samples  used  to  estimate  the 

noise  covariance  in  the  low  rank  method  as  Kj  and  the  sample  size  for 

> 

the  conventional  detector  as  K^,  to  attain  equivalent  performance  , 
must  be 


Kc  s  Kj  [  (  p  -  1  )/(  1  -  Cl2  )  ]  -  1 


(3.33) 
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CHAPTER  FOUR 


III )  Experimental  Results 

Computer  simulation  results  for  the  distribution  of  SNR  are 
presented  for  three  cases;  (1)  rank-1  interference  plus  white  noise, 
(2)  a  highly  correlated  l'st  order  autoregressive  noise  component  plus 


white  noise,  and  (3)  when  the  interference  data  being  used  to  estimate 


the  interference  covariance  matrix  is  contaminated  by  signal.  Further, 
for  the  rank-1  interference  plus  white  noise  case,  we  show  the 
improvement  of  the  low  rank  filter  weight  estimates  over  the 
conventional  estimate  (based  on  the  inversion  of  the  estimated  sample 
covariance  matrix). 

The  notation  is  the  same  as  in  sections  I  and  II.  The  rank-1 
interference  plus  white  noise  gaussian  noise  vector  is  generated  as 
follows  : 


P 


n. 


k 


(4.00) 


where  the  scale  factors  w^.j  are  zero-mean  and  independent  gaussian 
random  variables  with  variance 


Var [  wkl  ]  =  1  +  cr2 


(4.01) 


and  for  j=2, 3 . . . p 

Var[  w^j  ]  =  a2 


(4.02) 


The  vectors  rj  (j=l,2...p)  are  the  normalized  eigenvectors  of  the 


matrix  R.  The  elements  of  R  are 


(4.03) 
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The  matrix  R  corresponds  to  the  covariance  of  a  first  order  AR  process 
with  correlation  a,  therefore  the  noise  vector  nk  corresponds  roughly 
to  a  snapshot  of  a  l'st  order  autoregressive  noise  component  plus  white 
noise  if  cr  >>y.  (for  j=2,3.*.p)  where  the  y-  are  the  eigenvalues  of  R. 

J  J 

The  interference-to-no ise  ratio  is  defined  as 

INR  =  101og10(  1  /  per2  )  (4.02) 

where  p  is  the  covariance  matrix  order. 

The  signal  vector  we  shall  use  is 

sk  -  cos(  2ir  f  (k-1)  )  for  k=l,2...p  (4.03) 

where  f  is  the  frequency. 

For  our  computer  simulation,  we  set  a=.9999,  p=20,  K=25 

(covariance  sample  size).  Three  hundred  independent  trails  were 
performed  with  INR  being  varied  from  lOdB  to  15dB  and  the  signal 
frequency  varied  from  .03  to  .06  .  The  noise  covariance  matrix  was 

estimated  using  the  maximum-1 ikl ihood  estimate  formula  (1.08). 

Scattergrams  (see  Fig.  2)  show  that  the  SNR  approximation  is  accurate  . 
Next,  histograms  with  confidence  bounds  were  generated  using  the 

simulated  data.  The  confidence  bounds  were  calculated  by  noting  that 
the  frequency  count  in  a  particular  histogram  bin  follows  the  binomial 
distribution  and  then  using  the  DeMo irve-Lap lace  theorem  [8]  to 

estimate  the  standard  deviation  of  the  frequency  count, 

crt  =  V(  n  frk  (  1  -  frk  )  )  (4.04) 

where  n  is  the  number  of  trials  and  f  .  is  the  expected  frequency  for 
the  k'th  histogram  bin  obtained  using  the  derived  SNR  density  (3.25)  . 
Figure  3  shows  that  the  experimental  data  fits  the  SNR  density  (3.25) 
well. 

Next  we  show  that  the  probability  density  formula  (3.25)  for  SNR 
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can  be  also  used  to  predict  the  performance  of  the  detector  when  the 
interference  is  a  mixture  of  highly  correlated  l'st  order  AR  process 
noise  and  white  noise.  The  noise  vector  n^  is  generated  using  (4,00) 
and  the  same  parameters  as  before  except 

Var [  ]  =  Yj  +  a2  for  j=l,2...p  (4.05) 

where  y  j  (j=l,2...p),  are  the  eigenvalues  of  matrix  R,  and  the  value  of 
the  signal  frequency  f  is  .16  .  In  evaluating  the  SNR  density  formula 
(3.25)  ,  we  assume  that  ^2  is  proportional  to  cr  ,  that  is, 

2 

a 

X2  -  - j  (4.06) 

Y1+  <* 

or  equivalently  that  y^-0  for  k=2,3...p  ,  Histograms  (  see  Fig.  4  ) 
show  that  we  get  relatively  good  agreement  with  the  predicted 
distribution  . 

When  the  noise  data  is  contaminated  by  the  signal  that  is  being 
received,  that  is, 

”k  =  nk  +  S0S 

where  sq  is  a  scalar,  we  can  still  attain  reasonable  performance  using 
the  rank-1  filter  weight  estimate  .  This  is  shown  through  experimental 
results.  The  signal-to-white-noise  ratio  (SWNR)  of  the  contaminating 
signal  is  defined  as 

SWNR  =  101og10(  s02  /  2 a2  )  (4.07) 

Using  the  same  methodology  and  parameters  as  in  the  first  set  of 
experiments  (a=.9999,  INR=10dB,  ^=25)  and  with  signal  frequency 
f=.047,  we  generate  the  signal  contaminated  noise  data  using  (4.06)  and 
SWNR=-15dB  .  The  histogram  of  the  experimental  data  (see  Fig.  5)  and 
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statistics  indicate  even  with  signal  contamination,  we  can  still  attain 
relatively  high  values  of  SNR. 

By  evaluating  the  formula  for  the  expected  value  of  SNR  (1.11)  and 
the  density  formulas  derived  by  Reed,  Mallet,  Brennan  [1, formula  17] 
for  the  conventional  adaptive  detector  based  on  the  inverse  of  the 
sample  covariance  matrix  and  evaluating  the  density  of  our  improved 
detector  using  the  SNR  density  formula  (3.25)  ,  it  can  be  seen  that  for 
even  small  sample  sizes  (see  Fig.  6,7),  the  filter  weights  based  on  the 
principal  eigenvector  yield  superior  results  in  this  example. 

Below,  the  approximate  formulas  that  were  derived  in  Chapter  3  for 
the  expected  value  of  SNR  (3.27)  and  variance  (3.28)  are  evaluated  and 
compared  against  the  computer  simulation  results  obtained  earlier.  It 
can  be  seen  from  the  below  results,  that  formulas  (3.27)  and  (3.28)  are 
accurate . 


a)  mean  and  standard  deviation  of  SNR  calculated  using  the  approximate 
formulas  (3.27)  and  (3.28)  when  INR=10  dB,  a =.9999,  E>25 


11 

o 

LO 

:  E[SNR]=. 962  ,  Dev [SNR]=. 0542 

(4.08) 

►*+> 

li 

o 

:  E[SNR]=. 965  ,  Dev[SNR]=.0500 

(4.09) 

II 

o 

t-n 

:  E[SNR]=. 960  ,  Dev [SNR]=. 0566 

(4.10) 

f=.  06 

:  E[SNR]=. 963  ,  Dev [SNR]=. 0524 

(4.11) 

b)  mean  and  standard  deviation  of  SNR  obtained 

through 

compute  r 

s imulat ion 

based  on  300  independent  trials  and 

us  ing 

the  same 

parameters 

as  before 

f=.  03 

:  E[SNR]=. 965  ,  Dev [SNR] =.0442 

(4.12) 

f=.  04 

:  E[SNR]=. 965  .  Dev [SNR]=. 0419 

(4.13) 
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H> 

II 

o 

Ol 

:  E [SNR] =.967 

,  Dev [SNR] =.0438 

(4.14) 

f=. 06  : 

:  E[SNR]=. 967 

,  Dev [SNR]=. 0398 

(4.15) 
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CHAPTER  FIVE 
Conclus ion 

The  formulas  we  have  derived  are  useful  over  a  reasonable  range 
of  interference-to-noise  ratios  and  signal  types.  For  near  rank-1 
noise,  the  null  steerer  generally  provides  good  performance  over 
conventional  detectors  based  on  sample  covariance  matrix  inversion. 
Further,  these  results  should  give  insight  into  determining  optimal 
adaptive  detectors  and  their  performance  for  higher  rank  near  singular 
noise . 

The  reader  may  question  why  we  did  not  use  the  known  asymptotic 
distribution  of  the  principal  eigenvector  of  a  Wishart  matrix  [13]  in 
deriving  the  SNR  probability  density.  Through  experimentation  ,  we  have 
determined  that  the  power  method  approximation  for  the  principal 
eigenvector  of  the  estimated  sample  covariance  matrix  is  much  more 
accurate  for  small  sample  sizes  than  the  extreme  asymptotic 
distr ibut ion. 
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APPENDIX  A 

Determining  the  Form  and  Distribution  of 
We  will  compute  the  expansion  scale  factors  which  are  defined  in 
formula  (2.05)  and  show  that  the  x^  are  asympt ot icaly  gaussian.  Recall 
that  the  eigen-decomposition  of  N  is 

N  =  V  A  VT  ,  (al.O) 

Neglecting  its  length  ,  the  principal  eigenvector  of  N  is  approximated 
by  Nv^  and  it  can  be  represented  using  the  matrix  V  of  column  vectors 
which  are  the  eigenvectors  of  the  true  covariance  matrix  N  as  follows: 

N  v1  =  V  x  (al.l) 

in  which  x  is  the  pxl  column  vector  of  the  scale  factors. 

rwi 

^  —  [  x2  *  *  *  *  xp  ^  (al. 2) 

Then 

X  =  VT  N  VX  (al. 3) 

Next,  v^  can  be  rewritten  as 

y±  =  V  b  (al. 4 ) 

where  b  =  [  1  0  0  ,  ,  ,  0  .  Note  that  the  dimensions  of  b  are  pxl 

.  Now  substitute  formula  (al.4)  into  (al.3) 

x  =  VT  N  V  b  (al.  5) 

To  obtain  the  distribution  of  x  we  need  to  first  find  the  distribution 

T— 

of  V  NV  .  Use  a  theorem  of  Wishart  matrices  (from  [7]),  recalling  that 
N  is  Wishart  [13]  .  For  additional  discussion  and  use  of  the  Wishart 
distribution  of  estimated  covariance  matrices  see  (Anderson  [7]), 
(Goodman  [16]),  (Reed,  Mallet,  Brennan  [1])  and  (Capon  and  Goodman 
[17]). 

Theorem  B:  If  N  ~  Wp(  N.K  )  ,  then  VT  N  V  ~  ffp(  VT  N  V  ,  K)  . 

In  this  notation,  Y~Wp(X,K)  means  that  the  pxp  matrix  Y  is  Wishart 
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distributed  with  expected  value  X  and  K  degrees  of  freedom. 

Therefore 

VT  N  V  ~  wp(  VT  N  V  ,  K)  (al.6) 

The  distribution  parameters  of  (al.6)  can  be  simplified  by  substituting 
the  eigen-decomposition  of  N  in  place  of  N. 

Then 

VT  N  V  ~  Wp(  A  .  K  )  (al.7) 

where  A  is  the  diagonal  matrix  of  eigenvalues  of  N.  We  now  have  the 
distribution  of  V*NV  .  Anderson  [7]  has  shown  that  the  sample 
covariance  matrix  is  asymptotically  gaussian  distributed  as  the  sample 
size  increases.  The  equivalent  can  be  stated  for  Wishart  matrices  as  K 
.  The  theorem  from  Anderson  [7]  is  re-stated  below  for  the  case  of 
Wishart  matrices. 

Theorem  C:  If  ^  is  Wishart  Wp(  X  ,  K  )  ,  then  the  asymptotic 

distribution  of 


X 


1 


(al. 8) 


is  normal  with  mean  0  and  covariances 

E[  xij  xti  ]  =  ffik  aji  +  aii  ffjk 
where  x^j  is  the  i.j'th  element  of  matrix  X  (al.8)  and  a  — 

i,j  'th  covariance  from  £  . 


(al. 9) 
is  the 


Let 

Cat  T  ~ 

1  =  V1  N  V 

then 

x  =  %  b 


(a2.0) 

(a2. 1) 
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It  can  now  be  seen  that  x  is  simply  the  first  column  of  By 

application  of  theorem  C  directly  to  formula  (al.5)  and  using  formula 
(al.9),  it  can  be  easily  shown  that  x  is  asymtot ical ly  multivariate 
gaussian  with  mean 

E[  xT  ]  =  IT  =  [1  0  0  ...  0  ]T  (a2. 2) 

and  covariance  matrix 


(a2. 3 ) 


E[  (x-x)(x-x)^] 


2/K  0  0 

0  \  I K  0 

0  X  /K  0 


0 

0 


0 

0 


0 

0  \21 K  0 

o  x2/k 


of  dimension  pxp  and  where  K  is  the  number  of  vectors  used  in 
estimating  the  covariance  matrix  N.  Note  that  the  elements  of  x  are 
asymptot icaly  uncorrelated,  therefore  independent*  Further  ,  for 
reasonable  sample  size  we  can  consider  the  distribution  of  x  to  be 
approximatly  multivariate  gaussian  with  the  above  parameters. 


APPENDIX  B 

Means  and  Variances  of  and  the  Approximation  Errors 

In  appendix  B  we  will  first  compute  the  error  of  approximating  the 
products  djd^  (  formula  (2.16)  )  by  the  corresponding  asymptotic 

results  (  formulas  (2.17)  (2.18)  (2.19)  )  and  then  the  respective 

means  and  variances  of  and  the  approximation  errors  for  the  near 

rank  1  covariance  matrix  and  large  sample  case.  The  approximation  error 
Ajk  is  given  by 
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d.  dv 
J  k 


(bl.O) 


Through  substitution  of  formulas  (2.16),  (2.17),  (2.18),  and  (2.19) 

into  formula  (bl.O)  we  get  (it  is  noted  that  A^-0  ):  :  - 

For  j=l  ,k=2,3...p  the  error  is 


-Cl  xk  y 

Ik  2 

X1 


and  finally  for  j=2,3,...p 
k=2,3, . . ,p 


(bl.l) 


y 


+ 


y 


(bl.3) 


We  will  now  calculate  the  mean  and  variance  of  the  approximations  D • , 

j  x. 

(formulas  (2.17)  (2,18)  (2.19)  )  and  the  approximation  error  terms 

(formulas  (bl.l)  (bl.2)  (bl.3)  )  .  Since  and  Aj^'s  are  sums  of 

> 

ratios  of  uncorrelated  random  variables,  we  need  the  use  of  the 
following  formulas  for  eatimating  the  mean  and  variance  of  ratios  of 
two  random  variables.  Given  uncorrelated  random  variables  u  and  x,  then 
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_  E[x] 
~  E  [u] 


(bl.4) 


and 


(bl.5) 


These  approximations 


(bl.4)  and  (bl.5)  are  generaly  accurate  when 


(bl.6) 

E[  u  ]  t  0  ,  E[  u  ]  >>  o  (bl.7) 

u 

a  a 

and  - - —  <<  - - —  (bl.8) 

E[  u  ]  E[  x  ] 

where  crx  and  are  the  variances  of  x  and  u  respectively.  Note  that 

although  the  moments  of  these  ratios  might  not  exist  in  the  strict 
theoritical  sense,  these  estimates  (formulas  (bl.4)  and  (  bl.5)  ) 

should  give  an  good  indication  where  the  bulk  of  the  probability 

density  mass  of  the  ratio  x/u  lies  (using  the  Tchebycheff  inequality 
[8]).  Further,  note  that  the  above  conditions  (bl.6),  (bl.7),  and 

(bl.8)  are  essentially  satisfied  in  the  case  that  we  are  considering, 

near  rank  1  covariance  and  large  sample  size 
Note  that  throughout  the  mean  and  variance  results  we  shall  use 

P 

r  =  5  c2  (bi.9) 

l.  n 
n=2 

> 

We  now  calculate  the  expected  value  and  variance  of  the  approximations 
Djk  (  formulas  (2.17),  (2.18)  and  (2.19)  )  and  the  error  terms 

(formulas  (bl.l)  and  (bl.3)  )  using  formulas  (bl.4)  and  (bl.5)  . 
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1)  D 


11 


(b2. 0) 


E[  Dll> 


x2  r 


K  [  1  +  2/K  ] 


2  X 


2  r2 


(b2.1) 


Var[  Pi  ]  ~  2 — - r 

K^  [  1  +  2/K  T 


2)  Dj^  :  k  2,3. . .p 


E[  Dlk] 


s  0 


X2  c 


2  1 


Var[  DlkJ 


n=2 


K 


0)2. 2) 


0)2.3) 


°jj  1  j_2«3***P 


E[  D. .]  = 

JJ 


Var[  D..] 
JJ 


2 
c . 
J 


2  2 
4  X2  C1  Cj 


(b2. 4) 

(b2. 5) 


4)  Djk  :  j#k  for  j=2,3...p 


k=2, 3. . . p 


E[  D..]  s  c.  c. 
jk  j  k 

2  r  2  A  2  w 

X,  c.  [  c.  +  c.  J 

Var [  D  ]  =  - J - *— 

J* 


K 

The  mean  and  variance  of  the  error  is 


0)2.6) 


0)2.7) 
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1)  Alk  :  k-2,3...p 


E[V  = 


~X2  C1  Ck 

K  [  1  +  2/K  ] 


The  variance  of  the  terms  of  are 


Var 


ci  xk y 


2  2  2 

^2  C1  (  ck  +  r  } 

K2  [  1  +  2/K  ]2 


Var 


xk y 


\l  (  12  c2  r  +  3  r2 

2 _ k _ 

K3  [  1  +  6/K  ]2 


2)  Adj  :  j-2.S...p 


K  c2  -  2  X  c2  L  (  2  c?  +  T  ) 

EC  AJJ  ]  =  t  A  rrf-T  +  — - - 


K  [  1  +  2/K  ] 


K  +  12  K  [  1  +  1/K  ] 


The  variance  of  the  terms  Ajj  are 


Var 


2  2 
ci  xj 


<5  i1  4 
2  X2  C1 


K2  [  1  +  2/K  ]2 


Var 


2  c  .  x  .  y 

J  J 


4  k2  c2  (  c2  +  r  ) 

_ L-1 _ j 

K2  [,  1  +  2/K  ] 


(b2.  8) 


0)2.  9) 


0)3.0) 


0>3.1) 


0)3.2) 


(b  3 . 3 ) 
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Var 


2 

ILL 


4L3  (  12  c2  +  3  T  ) 

£ _ J _ 

K3  [  1  +  6/K  ]2 


(b3. 4) 


Var 


2  2 
Xk  y 


(24c4  +  P)  (72c2  +  9D  -  (2c2  +  D2 
J_ 1  J 


K'  [ 


1  +  (12/K)  (  1  +  1/K  ) 


Hb3.5) 


3)  A.fc  :  j^k  for  j=2,3...p 


k=2, 3. 


E [  A.,]  = 

jk 


-2  X.  c .  c 
2  J  k 

K  [  1  +  2/K  ] 


2  1.  c .  c, 

2  J  k 


K  +  12  K  [  1  +  1/K  ] 


(b3.6) 


Tbe  variance  of  the  terms  of  A 


jk 


are 


Var 


2 

ci  x-  xi 

1  J  k 


,2  4 

x2  ^ 


K2  [  1  +  2/K  ]2 


Var 


c .  x,  y 

J  k 


2  2  2 

x:  cz  (  cf  +  r  > 

2  j  k 

K2  [  1  +  2/K  ]2 


Var 


c,  x .  y 
k  J 


X2  ck 


2  i  c.  2 


+  r  ) 


K2  [  1  +  2/K  ]2 


(b3.7) 


(b 3 . 8) 


(3.9) 
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Var 


2  x.  x,  y 
J  £ 


4  X~ 


[  2  (  cj  +  ck  }  +  1 


[  1  +  6/K  ] 


Var 


x .  X-  y 

j  k 


2  , 


[  c?  c?  +  (  c?  +  cj  )  r  +  r2 

-LJe— i _ j  k _ 


K 


1  +  (12/K)  [  1  +  1/K  ] 


(b4. 0) 


(b4.1) 
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The  magnitude  of  Jhe  angle  between  the  principle 
eigenvector  of  E(  N  )  and  nT  is 
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Fig.  2)  SCATTERGRAMS  OF  TRUE  SNR  FORMULA  (1.10)  VS. 

APPROXIMATE  SNR  FORMULA  (1.23)  BASED  ON  300 
INDEPENDENT  TRIALS.  THE  EXPERIMENTAL  PARAMETERS 
ARE: 

a= . 9999  ,  p=20  (  COVARIANCE  MATRIX  ORDER) 

K=2S  (  COVARIANCE  SAMPLE  SIZE  ) 
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APPROXIMATE  SNR 
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APPROXIMATE  SNR 


2b)  I NR= 1 0  d»  , 


SIGNAL  FREQUENCY:  f=.05 
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APPROXIMATE  SNR 
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Ul 
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APPROXIMATE  SNR 


2d)  I NR=  1 0  c.B 


SIGNAL  FREQUENCY:  f=.03 
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APPROXIMATE  SNR 
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APPROXIMATE  SNR 


Ln 

N> 


rrrr  i  i  rr  i  i  i  i  i  i  m  i  i  n 


TRUE  SNR 

2f)  I NR=  i 5  dB  ,  SIGNAL  FREQUENCY:  f=.(U 
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APPROXIMATE  S.NR 


2g)  INR=  1 5  JB  ,  SIGNAL  FREQUENCY :  I*  = . tl 3 
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Fig.  3)  HISTOGRAMS  OF  SNR  FORMULA  (1.10)  BASED  ON  300 
INDEPENDENT  TRIALS  .  BOUNDS  ARE  PLACED  ON  THE  EXPLK IMENTALY 
OBTAINED  BIN  FREQUENCIES  ,  .ASSUMING  THAT  SNR  HAS  THE  . 
DERIVED  PROBABILITY  DENSITY  (3.25)  AND  THEN  CALCULATING 
THE  EXPECTED  VALUE  AND  ESTIMATED  STANDARD  DEVIATION  OF  THE 
BIN  FREQUENCY.  HISTOGRAMS  ARE  GENERATED  USING  30  EQUALLY 
SPACED  BINS.  THE  EXPERIMENTAL  PARAMETERS  ARE: 
a=.9999  ,  p=20  (  COVARIANCE  MATRIX  ORDER  ) 

K=25  (  COVARIANCE  SAMPLE  SIZE  ) 
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PROBABILITY 

.40  -i 


•  85  S:NU 

3a)  INR= 10  dB,  SIGNAL  FREQUENCY:  f*.06 
THE  STATISTICS  OF  SNR  ARE: 

MEAN  =  .96” 

STANDARD  DEVIATION  =  3.98E-2 


_  EXPERIMENTAL  SNR 

-  CONFIDENCE  BOUND  FOR  EACH 

HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 
STANDARD  DEVIATION  ABOUT  THE  EXPECTED 
BIN  FREQUENCY  USING  THE  BINOMIAL 
DISTRIBUTION 
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PROBABILITY 

.40 


Ln 

O' 


.00 


3b)  INR= 10  dB  ,  SIGNAL  FREQUENCY :  f = . 05 
THE  STATISTICS  OF  SNR  ARE: 

MEAN  =  .967 

STANDARD  DEVIATION  =  4.38E-2 


i - 1 - 1 - 1 - r 

1.0 

-  EXPERIMENTAL  SNR 

-  CONFIDENCE  BOUND  FOR  EACH 

HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 
STANDARD  DEVIATION  ABOUT  THE  EXPECTED 
BIN  FREQUENCY  USING  THE  BINOMIAL 
DISTRIBUTION 


PROBABILITY 

.40  n 


Ui 


.00 


3c)  INR=  10  dB  ,  SIGNAL  FREQUENCY :  f=.()4 
THE  STATISTICS  Of-  SNR  ARE: 

MEAN  =  .90S 

STANDARD  DEVIATION  =  4.I9E-2 


_  EXPERIMENTAL  SNR 

. . CONFIDENCE  BOUND  FOR  EACH 

HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 
STANDARD  DEVIATION  ABOUT  THE  EXPECTED 
BIN  FREQUENCY  USING  THE  BINOMIAL 
DISTRIBUTION 


PROBABILITY 

40 


U1 

00 


.00 


3d)  INR= 10  dB  ,  SIGNAL  FREQUENCY:  f=.03 
THE  STATISTICS  OF  SNR  ARE: 

MEAN  =  .965 

STANDARD  DEVIATION  =  4.42E-2 


4 


-  EXPERIMENTAL  SNR 

- . CONFIDENCE  BOUND  FOR  EACH 

HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 
STANDARD  DEVIATION  ABOUT  THE  EXPECTED 
BIN  FREQUENCY  USING  THE  BINOMIAL 
DISTRIBUTION 
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PROBABILITY 
40  -| 


3e)  INR=15  dB  ,  SIGNAL  FREQUENCY 
THE  STATISTICS  OF  SNR  ARE 
MEAN  =  .967 

STANDARD  DEVIATION  =  5.97E-2 


06 - EXPERIMENTAL  SNR 

-  CONFIDENCE  BOUND  FOR  EACH 

HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 
STANDARD  DEVIATION  ABOUT  THE  EXPECTED 
BIN  FREQUENCY  USING  THE  BINOMIAL 
DISTRIBUTION  .  - 
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PROBABILITY 


3f)  INR=15  dB  ,  SIGNAL  FREQUENCY:  f=.04 
THE  STATISTICS  OF  SNR  ARE: 

MEAN  ='  .966 

STANDARD  DEVIATION  =  4.18E-2 


-  EXPERIMENTAL  SNR 

. . CONFIDENCE  BOUND  FOR  EACH 

HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 
STANDARD  DEVIATION  ABOUT  THE  EXPECTED 
BIN  FREQUENCY  USING  THE -BINOMIAL 
DISTRIBUTION 
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PROBABILITY 

.40 


3g)  INR=15  JB  ,  SIGNAL  FREQUENCY:  t 
THE  STATISTICS  OF  SNR  ARE: 
MEAN  ,=  .965 

STANDARD  DEVIATION  =  4.-IOH-.? 


-  EXPERIMENTAL  SNR 

- CONI'  I DHNCi  BOUND  FOR  EACH 

HISTOGRAM  BIN  BASEL  ON  'HIE  ESTIMATED 
STANDARD  DEVIATION  ABOUT  THE  EXPECTED 
BIN  FREQUENCY  USING  THE  BINOMIAL 
DISTRIBUTION 
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rig.  4)  HISTOGRAMS  OF  SNR  FORMULA  (1.10)  BASED  ON  300 
INDEPENDENT  TRIALS  FOR  THE  CASE  WHEN  THE  NOISE 
CONSISTS  OF  A  l'st  ORDER  AUTOREGRESSIVE  COMPONENT 
PLUS  A  WHITE  NOISE  COMPONENT.  BOUNDS  ARE  PLACED  ..ON 
THE  E  X  PER IMENTA  LY  OBTAINED  BIN  FREQUENCIES,  ASSUMING 
I  HAT  SNR  HAS  THE  DERIVED  SNR  DENSITr  (.3. 25)  AND 
THEN  CALCULATING  THE  EXPECTED  VALUE  AND  ESTIMATED  , 
STANDARD  DEVIATION  OF  THE  BIN  FREQUENCY.  HISTOGRAMS 
ARE  GENERATED  USING  50  EQUALLY  SPACED  BINS.  HIE 
EXPERIMENTAL  PARAMETERS  ARE: 

u= . 9999  ,  p=20  (  COVARIANCE  MATRIX  ORDER  ) 

K=2S  (  COVARIANCE  SAMPLE  SIZE  ) 
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PROBABILITY 


Fig.  4) 


l'st  ORDER  AR  NOISE  PLUS  WHITE  NOISE 
INR  =  5  dB  ,  SIGNAL  FREQUENCY:  f=--.l<>- 
THE  STATISTICS  OE  SNR  ARE: 

MEAN  =  .9.3 

STANDARD  DEVIATION  =  7.76E-2 


-  EXPERIMENTAL  SNR 

-  CONFIDENCE  BOUND  FOR  EACH 

HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 
STANDARD  DEVIATION  A 3 OUT  THE  EXPECTED 
BIN  FREQUENCY  USING  HIE  BINOMIAL 
DISTRIBUTION 
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Fig.  5 J  HISTOGRAMS  OF  SNR  FORMULA  (1.10)  BASED  ON  300 
INDEPENDENT  TRIALS  FOR  THE  CASE  WHEN  THE  NOISE  BEING 
USED  TO  ESTIMATE  THE.  COVARIANCE  MATRIX  IS  CONTAMINATED 
BY  SIGNAL.  BOUNDS  ARE  PLACED  ON  THE  EXPERIMENTALY 
OBTAINED  BIN  FREQUENCIES,  ASSUMING  THAT  SNR  HAS  THE 
DERIVED  DENSITY  (3. 25)  AND  THEN  CALCULATING  THE  EXPECTED 
VALUE  AND  ESTIMATED  STANDARD  DEVIATION  OF  THE  BIN 
FREQUENCY.  HISTOGRAM  IS  GENERATED  USING  30  EQUALLY  SPACED 
BINS.  THE  EXPERIMENTAL  PARAMETERS  ARE: 


■a=.9999  ,  j=20  (  COVARIANCE  MATRIX  ORDER  ) 

K=25  (  COVARIANCE  SAMPLE  SIZE  ) 
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PROBABILITY 


Fig.  5)  SIGNAL  CONTAMINATED  NOISE 
INR=10  dB,  SWNR=-15  dB 
SIGNAL  FREQUENCY:  f=.045 
THE  STATISTICS  OF  SNR  ARE: 
MEAN  =  .72 

STANDARD  DEVIATION  =  .23 


J 
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t 


-  EXPERIMENTAL  SNR 

-  CONFIDENCE  BOUND  FOR  EACH 

HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 
STANDARD  DEVIATION  ABOUT  THE  EXPECTED 
BIN  FREQUENCY  USING  'III E  BINOMIAL 
DISTRIBUTION 
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E(  SNR  ) 


Fig.  6a)  THEORETICAL  EXPECTED  VALUE  OF  SNR  FOR  ilVO  METHODS  OF 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  INR= 10  dB,  f=.03  ,  p=20  ,  a=.9999 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  PRINCIPAL  EIGENVECTOR  fl.J5) 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  INVERSE  OF  THE  ESTIMATED 

COVARIANCE  MATRIX  (1.09) 
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E(  SNR  ) 


Fig.  6b)  THEORETICAL  EXPECTED  VALUE  OF  SNR  FOR  TWO  METHODS  OF 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  INR=10  dR  ,  f=.04  ,  p=20  ,ct=.99‘>9 

- USING  FILTER  WEIGHTS  BASED  ON  THE  PRINCIPAL  EIGENVECTOR  (1.15) 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  INVERSE  OF  THE  ESTIMATED 

COVARIANCE  MATRIX  (1.09) 
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E(  SNR  ) 


Fig.  6c)  THEORETICAL  EXPECTED  VALUE  OF  SNR  FOR  TWO  METHODS  OF 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  INR=10  dB,  f-,05  ,  p  =  20  ,  a=.9999 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  PRINCIPAL  EIGENVECTOR  (J.1S) 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  INVERSE  OF  'HIE  ESTIMATED 

COVARIANCE  MATRIX  (1.09) 
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Fig.  7a)  THEORETICAL  PROBABILITY  DENSITY  OF  SNR  FOR  TWO  METHODS  OF 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  INR=10  <JB ,  f=.()3  ,  K=25  ,  p=20 , 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  PRINCIPAL  EIGENVECTOR  ( 1 . 

- - USING  FILTER  WEIGHTS  BASED  ON  THE  INVERSE  OF  THE  ESTIMATED 

COVAR IA NCE  MATR IX  ( I .OR ) 


i=  .9999 
15) 
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Fig.  7b)  THEORETICAL  PROBABILITY  DENSITY  OF  SNR  FOR  TWO  METHODS  OF 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  INR=10  DB  ,  f=.03,  K  =  35  ,  p =;>(.)  ,a=.9999 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  PRINCIPAL  EIGENVECTOR  (X 15) 

- USING  FILTER  >V  El  GUTS  BASED  ON  THE  INVERSE  OF  THE  ESTIMATED 

COVARIANCE  MATRIX  (1.09) 
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Fig.  7c)  THEORETICAL  PROBABILITY  DENS 117  OF  SNR  FOR  TWO  METHODS  OF 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  INR=10  cIB  ,  f=.03  ,  K=45  ,  p=2U  ,  .=  .9999 

_  USING  FILTER  WEIGHTS  BASED  ON  Till.  PRINCIPAL  EIGENEVCTOR  (MS); 

-  USING  FILTER  WEIGHTS  BASED  ON  1111!  INVERSE  OF  THE  ESTIMATED 

COVARIANCE  MATRIX  (1.09) 
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USING  FILTER  WEIGHTS  BASED  ON  THE  PRINCIPAL  EIGENVECTOR  (1.15) 
USING  FILTER  WEIGHTS  BASED  ON  THE  INVERSE  OF  THE  ESTIMATED 
COVARIANCE  MATRIX  (1.09) 


+ 


.9999 
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Fig.  7e)  THEORETICAL  PROBABILIIT  DENSITY  OF  SNR  FOR  TOO  METHODS  0|: 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  1NR=10  dB  ,  f==.03  ,  K=6S  ,  p='!()  ,  a=,9999 

-  USING  FILTER  WEIGHTS  BASED  ON  1111:  PRINCIPAL  EIGENVECTOR  I  1,15) 

- USING  FILTER  WEIGHTS  BASED  ON  THE.  INVERSE  OF  THE  ESTIMATED 

COVARIANCE  MATRIX  (1.09) 
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.9999 
15)  ; 
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